Corrigendum to "Validation of a convolutional neural network that reliably identifies electromyographic compound motor action potentials following train-of-four stimulation: an algorithm development experimental study" [BJA Open 8 (2023) 100236].

[This corrects the article DOI: 10.1016/j.bjao.2023.100236.].

Derivation, External Validation and Clinical Implications of a deep learning approach for intracranial pressure estimation using non-cranial waveform measurements.

Importance: Increased intracranial pressure (ICP) is associated with adverse neurological outcomes, but needs invasive monitoring. Objective: Development and validation of an AI approach for detecting increased ICP (aICP) using only non-invasive extracranial physiological waveform data. Design: Retrospective diagnostic study of AI-assisted detection of increased ICP. We developed an AI model using exclusively extracranial waveforms, externally validated it and assessed associations with clinical outcomes. Setting: MIMIC-III Waveform Database (2000-2013), a database derived from patients admitted to an ICU in an academic Boston hospital, was used for development of the aICP model, and to report association with neurologic outcomes. Data from Mount Sinai Hospital (2020-2022) in New York City was used for external validation. Participants: Patients were included if they were older than 18 years, and were monitored with electrocardiograms, arterial blood pressure, respiratory impedance plethysmography and pulse oximetry. Patients who additionally had intracranial pressure monitoring were used for development (N=157) and external validation (N=56). Patients without intracranial monitors were used for association with outcomes (N=1694). Exposures: Extracranial waveforms including electrocardiogram, arterial blood pressure, plethysmography and SpO2. Main Outcomes and Measures: Intracranial pressure > 15 mmHg. Measures were Area under receiver operating characteristic curves (AUROCs), sensitivity, specificity, and accuracy at threshold of 0.5. We calculated odds ratios and p-values for phenotype association. Results: The AUROC was 0.91 (95% CI, 0.90-0.91) on testing and 0.80 (95% CI, 0.80-0.80) on external validation. aICP had accuracy, sensitivity, and specificity of 73.8% (95% CI, 72.0%-75.6%), 99.5% (95% CI 99.3%-99.6%), and 76.9% (95% CI, 74.0-79.8%) on external validation. A ten-percentile increment was associated with stroke (OR=2.12; 95% CI, 1.27-3.13), brain malignancy (OR=1.68; 95% CI, 1.09-2.60), subdural hemorrhage (OR=1.66; 95% CI, 1.07-2.57), intracerebral hemorrhage (OR=1.18; 95% CI, 1.07-1.32), and procedures like percutaneous brain biopsy (OR=1.58; 95% CI, 1.15-2.18) and craniotomy (OR = 1.43; 95% CI, 1.12-1.84; P < 0.05 for all). Conclusions and Relevance: aICP provides accurate, non-invasive estimation of increased ICP, and is associated with neurological outcomes and neurosurgical procedures in patients without intracranial monitoring.

Remote Monitoring and Artificial Intelligence: Outlook for 2050.

Remote monitoring and artificial intelligence will become common and intertwined in anesthesiology by 2050. In the intraoperative period, technology will lead to the development of integrated monitoring systems that will integrate multiple data streams and allow anesthesiologists to track patients more effectively. This will free up anesthesiologists to focus on more complex tasks, such as managing risk and making value-based decisions. This will also enable the continued integration of remote monitoring and control towers having profound effects on coverage and practice models. In the PACU and ICU, the technology will lead to the development of early warning systems that can identify patients who are at risk of complications, enabling early interventions and more proactive care. The integration of augmented reality will allow for better integration of diverse types of data and better decision-making. Postoperatively, the proliferation of wearable devices that can monitor patient vital signs and track their progress will allow patients to be discharged from the hospital sooner and receive care at home. This will require increased use of telemedicine, which will allow patients to consult with doctors remotely. All of these advances will require changes to legal and regulatory frameworks that will enable new workflows that are different from those familiar to today's providers.

Post-operative urinary retention is impacted by neuromuscular block reversal agent choice: A retrospective cohort study in US hospital setting.

STUDY OBJECTIVE: Perioperative neuromuscular blocking agents are pharmacologically reversed to minimize complications associated with residual neuromuscular block. Neuromuscular block reversal with anticholinesterases (e.g., neostigmine) require coadministration of an anticholinergic agent (e.g., glycopyrrolate) to mitigate muscarinic activity; however, sugammadex, devoid of cholinergic activity, does not require anticholinergic coadministration. Single-institution studies have found decreased incidence of post-operative urinary retention associated with sugammadex reversal. This study used a multicenter database to better understand the association between neuromuscular block reversal technique and post-operative urinary retention. DESIGN: Retrospective cohort study utilizing large healthcare database. SETTING: Non-profit, non-governmental and community and teaching hospitals and health systems from rural and urban areas. PATIENTS: 61,898 matched adult inpatients and 95,500 matched adult outpatients. INTERVENTIONS: Neuromuscular block reversal with sugammadex or neostigmine plus glycopyrrolate. MEASUREMENTS: Incidence of post-operative urinary retention by neuromuscular block reversal agent and the independent association of neuromuscular block reversal technique and risk of post-operative urinary retention. MAIN RESULTS: The incidence of post-operative urinary retention was 2-fold greater among neostigmine with glycopyrrolate compared to sugammadex patients (5.0% vs 2.4% inpatients; 0.9% vs 0.4% outpatients; both p < 0.0001). Multivariable logistic regression identified reversal with neostigmine to be independently associated with greater risk of post-operative urinary retention (inpatients: odds ratio, 2.20; 95% confidence interval, 2.00 to 2.41; p < 0.001; outpatients: odds ratio, 2.57; 95% confidence interval, 2.13 to 3.10; p < 0.001). Post-operative urinary retention-related visits within 2 days following discharge were five-fold higher among those reversed with neostigmine than sugammadex among inpatients (0.05% vs. 0.01%, respectively; p = 0.018) and outpatients (0.5% vs. 0.1%; p < 0.0001). CONCLUSION: Though this study suggests that neuromuscular block reversal with neostigmine can increase post-operative urinary retention risk, additional studies are needed to fully understand the association.

External validation of a predictive model for reintubation after cardiac surgery: A retrospective, observational study.

STUDY OBJECTIVE: Explore validation of a model to predict patients' risk of failing extubation, to help providers make informed, data-driven decisions regarding the optimal timing of extubation. DESIGN: We performed temporal, geographic, and domain validations of a model for the risk of reintubation after cardiac surgery by assessing its performance on data sets from three academic medical centers, with temporal validation using data from the institution where the model was developed. SETTING: Three academic medical centers in the United States. PATIENTS: Adult patients arriving in the cardiac intensive care unit with an endotracheal tube in place after cardiac surgery. INTERVENTIONS: Receiver operating characteristic (ROC) curves and concordance statistics were used as measures of discriminative ability, and calibration curves and Brier scores were used to assess the model's predictive ability. MEASUREMENTS: Temporal validation was performed in 1642 patients with a reintubation rate of 4.8%, with the model demonstrating strong discrimination (optimism-corrected c-statistic 0.77) and low predictive error (Brier score 0.044) but poor model precision and recall (Optimal F1 score 0.29). Combined domain and geographic validation were performed in 2041 patients with a reintubation rate of 1.5%. The model displayed solid discriminative ability (optimism-corrected c-statistic = 0.73) and low predictive error (Brier score = 0.0149) but low precision and recall (Optimal F1 score = 0.13). Geographic validation was performed in 2489 patients with a reintubation rate of 1.6%, with the model displaying good discrimination (optimism-corrected c-statistic = 0.71) and predictive error (Brier score = 0.0152) but poor precision and recall (Optimal F1 score = 0.13). MAIN RESULTS: The reintubation model displayed strong discriminative ability and low predictive error within each validation cohort. CONCLUSIONS: Future work is needed to explore how to optimize models before local implementation.

Validation of a convolutional neural network that reliably identifies electromyographic compound motor action potentials following train-of-four stimulation: an algorithm development experimental study.

Background: International guidelines recommend quantitative neuromuscular monitoring when administering neuromuscular blocking agents. The train-of-four count is important for determining the depth of block and appropriate reversal agents and doses. However, identifying valid compound motor action potentials (cMAPs) during surgery can be challenging because of low-amplitude signals and an inability to observe motor responses. A convolutional neural network (CNN) to classify cMAPs as valid or not might improve the accuracy of such determinations. Methods: We modified a high-accuracy CNN originally developed to identify handwritten numbers. For training, we used digitised electromyograph waveforms (TetraGraph) from a previous study of 29 patients and tuned the model parameters using leave-one-out cross-validation. External validation used a dataset of 19 patients from another study with the same neuromuscular block monitor but with different patient, surgical, and protocol characteristics. All patients underwent ulnar nerve stimulation at the wrist and the surface electromyogram was recorded from the adductor pollicis muscle. Results: The tuned CNN performed highly on the validation dataset, with an accuracy of 0.9997 (99% confidence interval 0.9994-0.9999) and F1 score=0.9998. Performance was equally good for classifying the four individual responses in the train-of-four sequence. The calibration plot showed excellent agreement between the predicted probabilities and the actual prevalence of valid cMAPs. Ten-fold cross-validation using all data showed similar high performance. Conclusions: The CNN distinguished valid cMAPs from artifacts after ulnar nerve stimulation at the wrist with >99.5% accuracy. Incorporation of such a process within quantitative electromyographic neuromuscular block monitors is feasible.

Artificial Intelligence and Machine Learning in Perioperative Acute Kidney Injury.

Acute kidney injury (AKI) is a common complication after a surgery, especially in cardiac and aortic procedures, and has a significant impact on morbidity and mortality. Early identification of high-risk patients and providing effective prevention and therapeutic approach are the main strategies for reducing the possibility of perioperative AKI. Consequently, several risk-prediction models and risk assessment scores have been developed for the prediction of perioperative AKI. However, a majority of these risk scores are only derived from preoperative data while the intraoperative time-series monitoring data such as heart rate and blood pressure were not included. Moreover, the complexity of the pathophysiology of AKI, as well as its nonlinear and heterogeneous nature, imposes limitations on the use of linear statistical techniques. The development of clinical medicine's digitization, the widespread availability of electronic medical records, and the increase in the use of continuous monitoring have generated vast quantities of data. Machine learning has recently shown promise as a method for automatically integrating large amounts of data in predicting the risk of perioperative outcomes. In this article, we discussed the development, limitations of existing work, and the potential future direction of models using machine learning techniques to predict AKI after a surgery.

Laboratory Result Reference Ranges Stratified for Patient-Reported Sex and Ethnicity Are More Closely Associated With Postoperative Outcomes Than Currently Used Reference Ranges: A Retrospective Data Analysis.

BACKGROUND: A single laboratory range for all individuals may fail to take into account underlying physiologic differences based on sex and genetic factors. We hypothesized that laboratory distributions differ based on self-reported sex and ethnicity and that ranges stratified by these factors better correlate with postoperative mortality and acute kidney injury (AKI). METHODS: Results from metabolic panels, complete blood counts, and coagulation panels for patients in outpatient encounters were identified from our electronic health record. Patients were grouped based on self-reported sex (2 groups) and ethnicity (6 groups). Stratified ranges were set to be the 2.5th/97.5th percentile for each sex/ethnic group. For patients undergoing procedures, each patient/laboratory result was classified as normal/abnormal using the stratified and nonstratified (traditional) ranges; overlap in the definitions was assessed between the 2 classifications by looking for the percentage of agreement in result classifications of normal/abnormal using the 2 methods. To assess which definitions of normal are most associated with adverse postoperative outcomes, the odds ratio (OR) for each outcome/laboratory result pair was assessed, and the frequency that the confidence intervals of ORs for the stratified versus nonstratified range did not overlap was examined. RESULTS: Among the 300 unique combinations (race × sex × laboratory type), median proportion overlap (meaning patient was either "normal" or "abnormal" for both methodologies) was 0.86 [q1, 0.80; q3, 0.89]. All laboratory results except 6 overlapped at least 80% of the time. The frequency of overlap did not differ among the racial/ethnic groups. In cases where the ORs were different, the stratified range was better associated with both AKI and mortality (P < .001). There was no trend of bias toward any specific sex/ethnic group. CONCLUSIONS: Baseline "normal" laboratory values differ across sex and ethnic groups, and ranges stratified by these groups are better associated with postoperative AKI and mortality as compared to the standard reference ranges.

Visual Analytics to Leverage Anesthesia Electronic Health Record.

BACKGROUND: Visual analytics is the science of analytical reasoning supported by interactive visual interfaces called dashboards. In this report, we describe our experience addressing the challenges in visual analytics of anesthesia electronic health record (EHR) data using a commercially available business intelligence (BI) platform. As a primary outcome, we discuss some performance metrics of the dashboards, and as a secondary outcome, we outline some operational enhancements and financial savings associated with deploying the dashboards. METHODS: Data were transferred from the EHR to our departmental servers using several parallel processes. A custom structured query language (SQL) query was written to extract the relevant data fields and to clean the data. Tableau was used to design multiple dashboards for clinical operation, performance improvement, and business management. RESULTS: Before deployment of the dashboards, detailed case counts and attributions were available for the operating rooms (ORs) from perioperative services; however, the same level of detail was not available for non-OR locations. Deployment of the yearly case count dashboards provided near-real-time case count information from both central and non-OR locations among multiple campuses, which was not previously available. The visual presentation of monthly data for each year allowed us to recognize seasonality in case volumes and adjust our supply chain to prevent shortages. The dashboards highlighted the systemwide volume of cases in our endoscopy suites, which allowed us to target these supplies for pricing negotiations, with an estimated annual cost savings of $250,000. Our central venous pressure (CVP) dashboard enabled us to provide individual practitioner feedback, thus increasing our monthly CVP checklist compliance from approximately 92% to 99%. CONCLUSIONS: The customization and visualization of EHR data are both possible and worthwhile for the leveraging of information into easily comprehensible and actionable data for the improvement of health care provision and practice management. Limitations inherent to EHR data presentation make this customization necessary, and continued open access to the underlying data set is essential.

Integration of feature vectors from raw laboratory, medication and procedure names improves the precision and recall of models to predict postoperative mortality and acute kidney injury.

Manuscripts that have successfully used machine learning (ML) to predict a variety of perioperative outcomes often use only a limited number of features selected by a clinician. We hypothesized that techniques leveraging a broad set of features for patient laboratory results, medications, and the surgical procedure name would improve performance as compared to a more limited set of features chosen by clinicians. Feature vectors for laboratory results included 702 features total derived from 39 laboratory tests, medications consisted of a binary flag for 126 commonly used medications, procedure name used the Word2Vec package for create a vector of length 100. Nine models were trained: baseline features, one for each of the three types of data Baseline + Each data type, (all features, and then all features with feature reduction algorithm. Across both outcomes the models that contained all features (model 8) (Mortality ROC-AUC 94.32 ± 1.01, PR-AUC 36.80 ± 5.10 AKI ROC-AUC 92.45 ± 0.64, PR-AUC 76.22 ± 1.95) was superior to models with only subsets of features. Featurization techniques leveraging a broad away of clinical data can improve performance of perioperative prediction models.

Protocol for pragmatic randomised trial: integrating electronic health record-based behavioural economic 'nudges' into the electronic health record to reduce preoperative testing for patients undergoing cataract surgery.

INTRODUCTION: Robust randomised trial data have shown that routine preoperative (pre-op) testing for cataract surgery patients is inappropriate. While guidelines have discouraged testing since 2002, cataract pre-op testing rates have remained unchanged since the 1990s. Given the challenges of reducing low-value care despite strong consensus around the evidence, innovative approaches are needed to promote high-value care. This trial evaluates the impact of an interdisciplinary electronic health record (EHR) intervention that is informed by behavioural economic theory. METHODS AND ANALYSIS: This pragmatic randomised trial is being conducted at UCLA Health between June 2021 and June 2022 with a 12-month follow-up period. We are randomising all UCLA Health physicians who perform pre-op visits during the study period to one of the three nudge arms or usual care. These three nudge alerts address (1) patient harm, (2) increased out-of-pocket costs for patients and (3) psychological harm to the patients related to pre-op testing. The nudges are triggered when a physician starts to order a pre-op test. We hypothesise that receipt of a nudge will be associated with reduced pre-op testing. The primary outcome will be the change in the percentage of patients undergoing pre-op testing at 12 months. Secondary outcomes will include the percentage of patients undergoing specific categories of pre-op tests (labs, EKGs, chest X-rays (CXRs)), the efficacy of each nudge, same-day surgery cancellations and cost savings. ETHICS AND DISSEMINATION: The study protocol was approved by the institutional review board of the University of California, Los Angeles as well as a nominated Data Safety Monitoring Board. If successful, we will have created a tool that can be disseminated rapidly to EHR vendors across the nation to reduce inappropriate testing for the most common low-risk surgical procedures in the country. TRIAL REGISTRATION NUMBER: ClinicalTrials.gov identifier: NCT04104256.

A Retrospective Analysis Demonstrates That a Failure to Document Key Comorbid Diseases in the Anesthesia Preoperative Evaluation Associates With Increased Length of Stay and Mortality.

BACKGROUND: The introduction of electronic health records (EHRs) has helped physicians access relevant medical information on their patients. However, the design of EHRs can make it hard for clinicians to easily find, review, and document all of the relevant data, leading to documentation that is not fully reflective of the complete history. We hypothesized that the incidence of undocumented key comorbid diseases (atrial fibrillation [afib], congestive heart failure [CHF], chronic obstructive pulmonary disease [COPD], diabetes, and chronic kidney disease [CKD]) in the anesthesia preoperative evaluation was associated with increased postoperative length of stay (LOS) and mortality. METHODS: Charts of patients >18 years who received anesthesia in an inpatient facility were reviewed in this retrospective study. For each disease, a precise algorithm was developed to look for key structured data (medications, lab results, structured medical history, etc) in the EHR. Additionally, the checkboxes from the anesthesia preoperative evaluation were queried to determine the presence or absence of the documentation of the disease. Differences in mortality were modeled with logistic regression, and LOS was analyzed using linear regression. RESULTS: A total of 91,011 cases met inclusion criteria (age 18-89 years; 52% women, 48% men; 70% admitted from home). Agreement between the algorithms and the preoperative note was >84% for all comorbidities other than chronic pain (63.5%). The algorithm-detected disease not documented by the anesthesia team in 34.5% of cases for chronic pain (vs 1.9% of cases where chronic pain was documented but not detected by the algorithm), 4.0% of cases for diabetes (vs 2.1%), 4.3% of cases for CHF (vs 0.7%), 4.3% of cases for COPD (vs 1.1%), 7.7% of cases for afib (vs 0.3%), and 10.8% of cases for CKD (vs 1.7%). To assess the association of missed documentation with outcomes, we compared patients where the disease was detected by the algorithm but not documented (A+/P-) with patients where the disease was documented (A+/P+). For all diseases except chronic pain, the missed documentation was associated with a longer LOS. For mortality, the discrepancy was associated with increased mortality for afib, while the differences were insignificant for the other diseases. For each missed disease, the odds of mortality increased 1.52 (95% confidence interval [CI], 1.42-1.63) and the LOS increased by approximately 11%, geometric mean ratio of 1.11 (95% CI, 1.10-1.12). CONCLUSIONS: Anesthesia preoperative evaluations not infrequently fail to document disease for which there is evidence of disease in the EHR data. This missed documentation is associated with an increased LOS and mortality in perioperative patients.

Successful Implementation of a Perioperative Data Warehouse Using Another Hospital's Published Specification From Epic's Electronic Health Record System.

BACKGROUND: Many hospitals have replaced their legacy anesthesia information management system with an enterprise-wide electronic health record system. Integrating the anesthesia data within the context of the global hospital information infrastructure has created substantive challenges for many organizations. A process to build a perioperative data warehouse from Epic was recently published from the University of California Los Angeles (UCLA), but the generalizability of that process is unknown. We describe the implementation of their process at the University of Miami (UM). METHODS: The UCLA process was tested at UM, and performance was evaluated following the configuration of a reporting server and transfer of the required Clarity tables to that server. Modifications required for the code to execute correctly in the UM environment were identified and implemented, including the addition of locally specified elements in the database. RESULTS: The UCLA code to build the base tables in the perioperative data warehouse executed correctly after minor modifications to match the local server and database architecture at UM. The 26 stored procedures in the UCLA process all ran correctly using the default settings provided and populated the base tables. After modification of the item lists to reflect the UM implementation of Epic (eg, medications, laboratory tests, physiologic monitors, and anesthesia machine parameters), the UCLA code ran correctly and populated the base tables. The data from those tables were used successfully to populate the existing perioperative data warehouse at UM, which housed data from the legacy anesthesia information management system of the institution. The time to pull data from Epic and populate the perioperative data warehouse was 197 ± 47 minutes (standard deviation [SD]) on weekdays and 260 ± 56 minutes (SD) on weekend days, measured over 100 consecutive days. The longer times on weekends reflect the simultaneous execution of database maintenance tasks on the reporting server. The UCLA extract process has been in production at UM for the past 18 months and has been invaluable for quality assurance, business process, and research activities. CONCLUSIONS: The data schema developed at UCLA proved to be a practical and scalable method to extract information from the Epic electronic health system database into the perioperative data warehouse in use at UM. Implementing the process developed at UCLA to build a comprehensive perioperative data warehouse from Epic is an extensible process that other hospitals seeking more efficient access to their electronic health record data should consider.

Development and validation of a deep neural network model to predict postoperative mortality, acute kidney injury, and reintubation using a single feature set.

During the perioperative period patients often suffer complications, including acute kidney injury (AKI), reintubation, and mortality. In order to effectively prevent these complications, high-risk patients must be readily identified. However, most current risk scores are designed to predict a single postoperative complication and often lack specificity on the patient level. In other fields, machine learning (ML) has been shown to successfully create models to predict multiple end points using a single input feature set. We hypothesized that ML can be used to create models to predict postoperative mortality, AKI, reintubation, and a combined outcome using a single set of features available at the end of surgery. A set of 46 features available at the end of surgery, including drug dosing, blood loss, vital signs, and others were extracted. Additionally, six additional features accounting for total intraoperative hypotension were extracted and trialed for different models. A total of 59,981 surgical procedures met inclusion criteria and the deep neural networks (DNN) were trained on 80% of the data, with 20% reserved for testing. The network performances were then compared to ASA Physical Status. In addition to creating separate models for each outcome, a multitask learning model was trialed that used information on all outcomes to predict the likelihood of each outcome individually. The overall rate of the examined complications in this data set was 0.79% for mortality, 22.3% (of 21,676 patients with creatinine values) for AKI, and 1.1% for reintubation. Overall, there was significant overlap between the various model types for each outcome, with no one modeling technique consistently performing the best. However, the best DNN models did beat the ASA score for all outcomes other than mortality. The highest area under the receiver operating characteristic curve (AUC) models were 0.792 (0.775-0.808) for AKI, 0.879 (0.851-0.905) for reintubation, 0.907 (0.872-0.938) for mortality, and 0.874 (0.864-0.866) for any outcome. The ASA score alone achieved AUCs of 0.652 (0.636-0.669) for AKI, 0.787 (0.757-0.818) for reintubation, 0.839 (0.804-0.875) for mortality, and 0.76 (0.748-0.773) for any outcome. Overall, the DNN architecture was able to create models that outperformed the ASA physical status to predict all outcomes based on a single feature set, consisting of objective data available at the end of surgery. No one model architecture consistently performed the best.